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[57] ABSTRACT 

Distributed comput ing environment (DOE) remote proce- 
dure calls (RPCs) are integrated with an advisory work load 
manager (WLM) to provide a way to intelligently dispatch 
RPC requests among the available application server pro- 
cesses. The routing decisions are made dynamically (for 
each RPC) based on interactions between the location broker 
and an advisory work load manager. Furthermore, when the 
system contains multiple coupled processors (tightly 
coupled within a single frame, or loosely coupled within a 
computing complex, a local area network (LAN) 
configuration, a distributed computing enviroomenl (DCE) 
cell, etc.), the invention extends to balance the processing of 
RPC requests and the associated client sessions across the 
coupled systems. Once a session is assigned to a given 
process, the invention also supports performance monitoring 
and reporting, dynamic system resource allocation for the 
RPC requests, and potentially any other benefits that may be 
available through the specific work load manager (WLM). 

6 Claims;, 3 Drawing Sheets 



-ill. 

CUENT 

RPC 

CALLER 



LOCATION 

BROKER 

(DCED) 



ADVISORY 
WORK LOAD 
MGR. 



14 



T 



121 



1 



PROCESS 1 
DCE APPL. 
SERVER 



122 



PROCESS 2 
DCE APPL 
SERVER 



12n 



1 



PROCESS n 
DCE APPL. 
SERVER 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



May 23, 2000 



Sheet 1 of 3 



6,067,580 





i 




, CO 


Q_ 




oo 

U_l 




etc 

UJ 






o 


UJ 


LlJ 




O 


CL. 




cn 















CO 
Lj-I 




ct: 


<-> 






O 


LU 


ct: 

UJ 






a_ 




CO 



CM 





CD 



I— ^ 

S UJ 
UJ — I 
Q_ ^ 

CJ) O 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent May 23, 2000 sheet 2 of 3 6,067,580 




LxJ 
CO 



O CJ) 

:s o 

LU Qt: 



T 



on 



CM 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent May 23, 2000 sheet 3 of 3 6,067,580 




03/15/2004, EAST Version: 1.4.1 



6,067,580 

1 2 

INTEGRATING DISTRIBUTED COMPUTING sions across the coupled systems. Once a session is assigned 

ENVIRONMENT REMOTE PROCEDURE to a given process, the invention also supports perfornaance 

CALLS WITH AN ADVISORY WORK LOAD monitoring and reporting, dynamic system resource alloca- 

MANAGER tion for the RFC requests, and potentially any other benefits 

5 that may be available through the specific work load man- 

BACKGROUND OF THE INVENTION ager (WLM). 



1. Field of the Invention 



BRIEF DESCRIPTION OF THE DRAWINGS 



The present invention generally relates to distributed data 

processing systems of the type referred to as client/server jq foregoing and other objects, aspects and advantages 

systems and, more particularly, to integrating distributed ^^^^^^ understood from the following detailed 

computing environment (DCE) remote procedure calls description of a preferred embodiment of the invention with 

(RPCs) with an advisory work load manager (WLM) in a reference to the drawings, in which: 

way that intelligently dispatches RPC requests among avail- FIG. 1 is a simplified block diagram of a client/server 

able application server processes. system which implements a preferred embodiment of the 

2. Backgroimd Description present invention; 

aient/server architecture makes use of the distributed 2 is a block diagram illustrating the data flow of the 

intelligence of both the servers and workstations in a net- ^^^^^ runtime and WLM interactions; and 

work to exploit the full computing power of both servers and FIG. 3 is a block diagram illustrating the data flow of the 
workstations. This is done by splitting the processing of an 20 server initialization, 
application between two distinct components, the "front- 

end" chent workstation and the "back-end" server. The DETAILED DESCRIPTION OF A PREFERRED 

client component can be a complete, stand-alone worksta- EMBODIMENT OF THE INVENTION 

tion or personal computer that offers a full range of power Referring now to the drawings, and more particularly to 

and features for running applications. The server component 25 ^^^^^ ^ ^^^^ ^ ^^^^^ diagram form a typical 

enhances the cUent component by providing additional cUent/server architecture which implements the present 

computmg power, allowing the client to off-load some of the invention. A single client U is shown for purposes of 

computmg burden. Thus, the chent and server work together simpHdty of iUustration and description, but those skUled in 

to accomplish the processing of the application, both ^1,^ ^rt wiU recognize that there will, in practice, be many 

mcreasmg the processing power available and utilizing that 30 ^^^^^ ^ ^^^^^.^ ^^^^ ^^^^^^^^ 

power more efficienUy. Hie chent portion of the apphcaUon servicing remote procedure calls (RPCs) from the cUent. The 

IS typically optunized for user interaction, while the server invention provides a way for routing RPC requests to the 

poruon provides multiuser functionaUty. ^^rver that may be available in the system, or in a 

Remote procedure calls (RPCs) in cunrent client/server network of systems. To this end, there is provided a location 

environments are serviced by a server whose process broker, or DCE Daemon (DCED), 13 and an advisory work 

address is selected by a location broker (known as end point load manager (WLM) 14. 

mapper located in the DCE Daemon (DCED) in a DCE ^est way to describe the interactions of the basic 

implementation) without any attempt to account for system components illustrated in FIG. 1 is via an example of the 

resources or activity. This can result m processing delays if ^teps that take place when the client U makes an RPC call, 

the server selected is currently busy with an RPC from ini6„]ly, the application servers 12, to 12„ register their 

another client. Likewise, if an idle server is not selected, interfaces with the location broker (DCED) 13, as shown by 

available resources are wasted. As a result, a number of load s,ep i. jhis process is described in more detail below, 

balancing schemes have been developed in order to balance Du^ng this phase, the advisory work load manager (WLM) 

the processing loads among servers, but these generally have 14 ^^^^ ^^^^^ instance. The client 11 makes 

been quite meffective. Typically, the location broker pro- Rpc request in which the target server's IP address and 

vides addressing information (binding) for locating server ^^^y ^e known. Such requests 

processes on a parUcuIar host. implicitly get routed to the location broker 13, as shown by 

SUMMARY OF THE INVENTION f P '"f"'!"" ^^?'^^'^f ^t"^^ " ^"'^'i 

5Q detcrmmes which server would be the best m terms of 

It is therefore an object of the present invention to provide performance and resource load balancing and provides the 

a method of integrating distributed computing environment addressing information (of the "best" server) to the location 

(DCE) remote procedure calls (RPCs) with an advisory broker 13. In the example illustrated in FIG. 1, the appli- 

work load manager (WLM) in a simple and effective man- cation server 12„ has been chosen. This is indicated in FIG. 
ner. 55 1 by steps 3 and 4. 

For systems that allow multiple instances of the same The following steps 5 and 6 refer to the case where the 

server to be started, the invention provides a way to intel- client is using a connection oriented protocol (also known as 

ligeatly dispatch RPC requests among the available server CO or CN, in which case communication takes place using 

processes. The routing decisions are made dynamically each TCP/IP protocol) and allowing DCE to implicitly resolve the 
time a binding is resolved based on interactions between the 60 binding to a server instance or the client is using a DCE 

location broker and an advisory work load manager, function to exphcitly resolve the binding. Where connection 

Furthermore, when the system contains multiple coupled oriented protocol is used, or in the case of explich binding 

processors (tightly coupled within a single frame, or loosely resolution, the addressing information is routed to the client 

coupled within a computing complex, a local area network H' With addressing now complete, the request is routed to 
(LAN) configuration, a distributed computing environment 65 the application server. 

(DCE) cell, etc.), the invention extends to balance the The next step 7 refers to the case where the client is using 

processing of RPC requests and the associated client ses- a connectionless protocol and allowing DCE to impHcitly 
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resolve the binding. In this case, the behavior for clients 4. The server registers with the location broker 13. 

using the connectionless protocol (also known as Datagram 5 jhe location broker 13 completes the registration, 

or DG, where communication takes place using UDP/IP with the help of the WLM 14, the location broker 13 can 

Sy^^S allowing implicit resolution of the binding by decisions on where to forward RFC requests. This 

DCb ddters here, and the request is directly forwarded to the 5 ^^^^^^^ ^^es mechanisms on top of the existing DCE 

server (frotn the location broker 13) for processing. This implementation to do optimal resource utilization. The steps 

process by which the location broker 13 forwards the request described here represent the logic of how the overaU scheme 

^ caUed call forwardmg When the server returns after ^^^j^ However, the specific implementation may differ 

finishing processmg, the chent 11 updates its addressing ^^^^^^^ ^^^^^^ application related issues. For example, 

mtormation tor the server items indicated to be executed from the stub may actually be 

After the mitial request processmg by the server whose implemented in Hne; however, the overall flow would stay 

addressing information was provided by interaction of the same 

location broker 13 and WLM 14, fiiture requests by this While the invention has been described in terms of a 

cHcnt for the server will be du-ectly routed to the same ^^^^^ preferred embodiment, those skilled in the art will 
server, regardless of performance or work load charactens- 15 recognize that the invention can be practiced with modifi- 

tics. One exception to this situation is the case where the nation within the spirit and scope of the appended claims, 

client takes exphcit steps to clear out server address Having thus described our invention, what we claim as 

information, and in that case with server addressing infor- ^nd desire to secure by Letters Patent is as foUows: 

mation being incomplete, the request wiU get routed to the j ^ method of integrating distributed computing envi- 
location broker 13 with the result that the steps described 20 ronment (DCE) remote procedure calls (RPCs) with an 

above will be repeated. The process of clearmg the binding advisory work load manager (WLM) to intelligently dis- 

mformation is also an opportunity for re-balancmg of the p^tch RFC requests among available server processes, the 

work load on the next RPC request using this bmding. including a plurality of coupled servers and at least one 

The work load manager (WLM) 14 is the one component client which makes RPCs, the method comprising the steps 
that makes decisions on which may be the "best** server at 25 of: 

a given time. This decision is based on data collected from dynamicaUy making routing decisions to one of a plural- 
servers that may be runnmg, if any, along with other data ^^y of server processes based on interactions between a 
related to individual systems and their workloads. These ^^^^^^^^ broker and the advisory work load manager 
servers when processmg an RPC request pass on relevant /^^M) to select a server according to performance and 
data to the WLM 14 which aUows the WLM to make 30 ^^^^^^^ i^ad balancing suitable to handle an RPC 
decisions. This mteraction of server and WLM is illustrated ^ providing addressing information of the 
m FIG. 2 and descnbed below with reference to the nam- s^i^cted server to the location broker; and 
bered data flow arrows. ^ . , , 

^ ^ ^ once an RPC request is assigned to a given server process, 

1. Aremote procedure is mvoked from the chent, and the thereafter making RPCs directly to the selected server, 
stub part of the remote procedure gets control and 35 ^ ^^^^^ ^^^.^^^ ^ ^^^^ ^ ^^^^^^ 
execution starts here. interfaces with the servers through the location broker, the 

2. In the stub, the WLM 14 is informed about the step of dynamically making routing decisions is based on 

mvocation and attributes associated with the caU. In a jata registered at the WLM comprising the steps of: 

practical implementation, this may not happen in the n ^ . ^ *u * • j j * 

^^^^ ^ ' ^ collecting data from servers that are runnmg and data 

^ ' ^ ^ . related to individual systems and workloads; and 

3. The WLM 14 registers attributes and returns control to , * j * . ti^t »x l t. 

^, ^ passmg relevant data to the WLM by a server when the 

the server. ^ ^ . . ^ 

^ ^ ^ ^ , , server is processmg an RPC. 

4. The server 12, executes the procedure and passes 3 ^^^^hod recited in claim 2 wherein the step of 
control back to the stub. p^.^g ^^^^^^^ ^^^^ comprises the steps of: 

5. The stub in the server 12: informs the WLM 14 that the • • nnr^ 1 1* 

, jr«_,,rT», receivmg an RPC request invoked by a chent; 

remote procedure has been executed. The WLM can , „ . , , , . , , 

use this information for work load balancing or other ii^forming the WLM about the RPC mvoked by the chent 

and any attributes associated with the RPC; 

purposes. ' 

6. The stub gets control back from the WLM 14. '^l^^^^ntrol to^th^^er '^'''^^^ ^""^ 

7. Finally, the stub returns control back to the caller (i.e., ro o e server, 

the chent). executing the RPC by the server and informing the WLM 

Whenever the server (that can process the RPC request) that the procedure has been executed; and 

gets started, it registers with the location broker 13. Now, returning control the client, 

keeping automatic selection/routing in mind, the server also 55 4. The method recited in claim 3 further comprising the 

needs to register itself with the WLM 14. This interaction is step of the server registering itself with the WLM, which 

illustrated in FIG. 3 and described bek)w with reference to step of registering with the WLM comprising the steps of: 

the numbered data flow arrows. inquiring by the server from the WLM as to whether or 

1. The server 12^ mquires from the WLM 14 as to whether not the server is managed by the WLM; 

or not the server is managed by the WLM 14. gQ if the server is not managed by the WLM, continuing 

2. The WLM 14 informs the server 12^ if the server is normal registration with the location broker by the 
WLM managed or not. If the server is not WLM server without registration with the WLM; and 
managed, the server continues with normal registration if the server is managed by the WLM, registering by the 
with the location broker 13, and no registration takes server with the WLM and the location broker. 

place with the WLM 14. 55 5. A distributed computing environment (DCE) compris- 

3. If the server 12^- is WLM managed, the server registers ing: 

with the WLM 14. a plurality of coupled application servers; 
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at least one client which makes remote procedure calls 
(RPCs); 

a location broker interfacing with the plmality of appli- 
cation servers, said application servers being registered 
with the location broker; 5 

an advisory work load manager (WLM) connected to the 
location broker for intelligently dispatching RFC 
requests among available application servers, the loca- 
tion broker accessing the WLM to dynamically make 
routing decisions to one of the application servers to 
select an application server according to performance 
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and resource load balancing, to handle an RFC and 
providing addressing information of the selected appli- 
cation server to the location broker, and once an RFC 
is assigned to a selected application server, RPCs from 
a client are made directly to the selected application 
server. 

6. The distributed computing environment recited in 
claim 5 wherein the application servers are also registered 
with the WLM. 
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